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Abstract. MODerate resolution Imaging Spectroradiometer 
(MODIS) instruments aboard the Terra and Aqua satellites 
have provided a rich dataset of aerosol information at a 1 0 km 
spatial scale. Although originally intended for climate appli- 
cations, the air quality community quickly became interested 
in using the MODIS aerosol data. However, 10 km resolution 
is not sufficient to resolve local scale aerosol features. With 
this in mind, MODIS Collection 6 includes a global aerosol 
product with a 3 km resolution. Here, we evaluate the 3 km 
product over the Baltimore-Washington D.C., USA, corri- 
dor during the summer of 201 1 by comparing with spatially 
dense aerosol data measured by airborne High Spectral Res- 
olution Lidar (HSRL) and a network of 44 sun photometers 
(SP) spaced approximately 10 km apart, collected as part of 
the DISCOVER-AQ field campaign. The HSRL instrument 
shows that AOD can vary by over 0.2 within a single 10 km 
MODIS pixel, meaning that higher resolution satellite re- 
trievals may help to better characterize aerosol spatial dis- 
tributions in this region. Different techniques for validating a 
high-resolution aerosol product against SP measurements are 
considered. Although the 10 km product is more statistically 
reliable than the 3 km product, the 3 km product still per- 
forms acceptably with nearly two-thirds of MODIS/SP col- 
locations falling within an expected error envelope with high 
correlation ( R > 0.90), although with a high bias of ~ 0.06. 
The 3 km product can better resolve aerosol gradients and 
retrieve closer to clouds and shorelines than the 10 km prod- 
uct, but tends to show more noise, especially in urban ar- 
eas. This urban degradation is quantified using ancillary land 


cover data. Overall, we show that the MODIS 3 km product 
adds new information to the existing set of satellite derived 
aerosol products and validates well over the region, but due 
to noise and problems in urban areas, should be treated with 
some degree of caution. 


1 Introduction 

For over 12 yr, the MODerate resolution Imaging Spectro- 
radiometer (MODIS) instruments, flying aboard the Terra 

and Aqua satellites, have been collecting data concerning 
the global distribution of climate related variables. Several 
of these variables describe aerosols, which have been shown 
to be one of the largest sources of uncertainty in the climate 
system (IPCC, 2007). MODIS provides a suite of informa- 
tion about aerosol properties, including aerosol optical depth 
(AOD) and aerosol sizing parameters, that have been used 
extensively for climate studies (e.g. Kaufman et al., 2002; 
Bellouin et al., 2005; Quaas et al., 2008). Currently, three 
algorithms are used operationally to provide products to the 
public - the dark target algorithm over land (Kaufman et al., 
1997a; Levy et al., 2007b, 2010), the dark target algorithm 
over ocean (Tanre et al., 1997; Remer et al., 2005, 2008) and 
the deep blue algorithm over land (Hsu et al., 2004, 2006). 
All produce data at a 10 km nominal spatial scale, which is 
an appropriate scale for climate studies (Remer et al., 2013). 

Soon after launch, it was realized that the retrieved aerosol 
parameters could be used as proxies for estimating surface 
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air quality conditions (e.g. Hutchison, 2003; Wang and 
Christopher, 2003; Chu et al., 2003; Engels-Cox et al., 2004; 
Hutchison et al., 2004). The MODIS instruments are particu- 
larly appealing for air quality applications because the broad 
(2330 km) swath of the instrument allows most global loca- 
tions to be monitored on a nearly daily basis. However, the 
10 km resolution of the MODIS aerosol products is insuffi- 
cient to resolve small-scale aerosol features, including point 
sources in urban areas (C. C. Li et al., 2005) and small fire 
plumes (Lyapustin et al., 2011). Although several research 
techniques exist to retrieve aerosols at higher spatial scales 
(100 m to 1 km) from MODIS observations (e.g. Lyapustin 
et al., 2011; Li et al., 2012), these have not been produced 
globally in an operational environment. 

In response to clear scientific needs for aerosol observa- 
tions at a higher spatial resolution, MODIS Collection 6 will 
include a global aerosol product at nominal 3 km scale, in 
addition to the standard 10 km resolution. This 3 km product 
will include retrievals based on both dark target algorithms 
(land and ocean). Remer et al. (2013), describe the 3 km 
product in detail, and analyze a six-month test database to 
compare the performance of the 3 km and 10 km products on 
a global scale. The 3 km product can show more spatial de- 
tail than the 10 km product, but agrees less well with ground- 
based sun photometers on a global scale. However, the 3 km 
product may be better at characterizing aerosol distributions 
on local scales, and can only be tested through comparison 
with dense observations on a small spatial scale. We wish 
to examine the 3 km aerosol product on a regional scale to 
determine the additional information content that the higher 
resolution retrieval provides, and the possible degradation in 
data quality introduced by moving to a higher resolution. 

In this work, we focus primarily on AOD, because it has 
been used for surface air quality applications (van Donkelaar 
et al., 2006) and can easily be compared with lidar and sun 
photometer data. Specifically, we can evaluate AOD prod- 
ucts at both 10 km and 3 km resolutions by comparing with 
surface- and airborne-based AOD measurements collected 
during the D1SCOVER-AQ field campaign conducted during 
the summer of 2011 over the Baltimore- Washington D.C. 
corridor of the United States. We first assess the similarities 
and differences in 10 km and 3 km MODIS AOD images, and 
evaluate whether the 3 km product provides information that 
is not captured by the 10 km product. We look critically at 
the best method to validate the higher resolution aerosol re- 
trieval against sun photometer measurements, and validate 
the 1 0 km and 3 km products for the campaign duration. The 
ability of the MODIS product at both 10 km and 3 km resolu- 
tions to capture spatial variability in AOD is also addressed. 
Due to the limited validation data for the over ocean vari- 
ables, we will only address the land variables in this study. 


2 The MODIS 3 km land algorithm 

The retrieval method of the global MODIS 3 km aerosol 
product is thoroughly detailed in Remer et al. (2013). For 
the sake of completeness, we will briefly describe the land 
algorithm here. The 3 km algorithm emerges from the “dark 
target” retrieval methodology (Kaufman et al., 1997a; Tanre 
et al., 1997; Remer et al., 2005; Levy et al., 2007b, 2013), 
based on the concept that in the visible wavelengths, aerosols 
are bright and vegetated surfaces tend to be dark. The spec- 
tral contrast between aerosols and the surface can be used to 
retrieve quantitative information about aerosol properties. 

To increase signal-to-noise, the MODIS algorithm re- 
trieves aerosol parameters at a lower spatial resolution than 
the nominal (at nadir) 500 m top of atmosphere (TOA) re- 
flectance measurements. The algorithm creates N by N “re- 
trieval boxes” of pixels, in order to filter out the subset that is 
not desirable for aerosol retrieval. Thus, the 10 km algorithm 
works with 20x20 pixel retrieval boxes (400 pixels), whereas 
the 3 km algorithm works with 6x6 pixel retrieval boxes (36 
pixels). Remer et al. (2013) describes how pixels are masked 
for cloud (Martins et al., 2002), sediments in water (Li et al., 
2003), snow and ice (R. Li et al., 2005) and surfaces that are 
too bright for retrieval. The remaining pixels are sorted by 
their 0.66 pm reflectance, and the brightest 50% and darkest 
20 % of the remaining pixels are discarded. This means that 
in the 10 km (3 km) algorithm, there are at most 120 pixels 
(1 1 pixels) remaining from which to do aerosol retrieval. The 
reflectances of these remaining pixels are averaged, result- 
ing in a set of spectral reflectance values to drive the aerosol 
retrieval. These spectral reflectance values are further “cor- 
rected” for gas absorption (e.g. Levy et al., 2013). 

The expected “quality” of the retrieval is determined by 
the number of pixels that remain after all masking and fil- 
tering. If at least 51 pixels remain (out of 120) for 10 km or 
5 pixels remain (out of 1 1) for 3 km, the retrieval is initially 
expected to be of “high” quality. The 10 km retrieval will be 
attempted only if 12 pixels remain (out of 120), but it is ex- 
pected to be of low quality. There is no corresponding low 
quality attempt for the 3 km retrieval (Remer et al., 2013). 

The over land algorithm performs the retrieval by match- 
ing the observed TOA spectral reflectance with lookup tables 
of pre-computed TOA spectral reflectance. The largest un- 
certainty is in characterizing the contribution of the surface 
to the TOA reflectance, for which errors of 0.01 can lead 
to errors of 0.1 in retrieved AOD. Kaufman et al. (1997b) 
showed that the surface contribution in the 0.47 and 0.66 pm 
bands can be related to the surface contribution in the 
2.1 pm shortwave-IR (SWIR) band. The assumed relation- 
ship between the visible and SWIR was refined by Levy et 
al. (2007b), and is used as a constraint in the aerosol retrieval. 
As described by Levy et al. (2007b), the current retrieval uses 
three channels (0.47 pm, 0.66 pm, and 2.1 pm) to determine 
both the amount of aerosol (total AOD) and the relative ra- 
tio of fine and coarse aerosol models. The selection of the 
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fine and coarse aerosol models are prescribed by season and 
location. The resulting primary retrieved aerosol parameters 
over land are total AOD at 0.55 pm, the fractional contribu- 
tion of the fine-dominated aerosol type, the constrained sur- 
face reflectance, and fitting error (Levy et al., 2013). All of 
these assumptions (aerosol lookup tables, assumed surface 
reflectance relationship, and methodology of the inversion) 
are identical for both 1 0 km and 3 km retrievals (e.g. Levy et 
al., 2013; Remer et al., 2013). 

Previously, the MODIS 10 km product has been thor- 
oughly evaluated against sun photometers on global scales. 
The global expected error (EE) of the 10 km AOD at 0.55 pm 
product over land is ±0.05 ±0.15 AOD (Levy et al., 2010), 
and a testbed of 10 km data produced with the Collection 
6 MODIS algorithm shows that, globally, 69 % of MODIS- 
Aqua land AOD retrievals fall within this range when col- 
located and compared to ground-based sun photometer mea- 
surements (Levy et al., 2013). Remer et al. (2013) has com- 
pared the same testbed of global 3 km AOD data with sun 
photometers and show that it tends to validate less well than 
the 10 km. Specifically, since only 63 % of global colloca- 
tions fell within expected error over land, a new expected er- 
ror of ±0.05 ± 0.20 AOD has been established for the 3 km 
land product (Remer et al., 2013). Although a new 3 km EE 
has been established, we choose to continue to use the more 
stringent 10 km EE in this paper. Therefore, in this paper, 
when “EE” is referred to, the ±0.05 ±0.15 AOD definition 
is employed, unless otherwise stated. 

3 Data sources 

3.1 MODIS products 

This analysis uses five minute time length sections of 
the MODIS orbits, termed “granules”, collected between 
20 June 2011 to 31 July 2011 from both the Aqua and Terra 
satellites. The granules were created outside of the MODIS 
operational framework using the finalized MODIS aerosol 
Collection 6 algorithm and Level IB inputs. Therefore, small 
differences between these granules and the publicly released 
granules are not expected, but may exist. Additionally, the 
MODIS land surface cover product (MCD12Q1) is used to 
characterize surface type. The land cover product uses a 
trained algorithm to characterize land surface at a 500 m 
resolution using 5 different classification schemes (Freidl et 
al., 2010). In this work, we only consider the 17-class In- 
ternational Geosphere-Biosphere Programme (IGBP) system 
(Loveland and Belward, 1997). Data from both the Terra and 
Aqua satellites are included in both the training dataset and 
the product. 

3.2 AERONET/DRAGON 

The AErosol RObotic NETwork (AERONET) (Holben et 
al., 1998) has 5 permanent stations operating in the study 


region. These stations were supplemented with an additional 
39 temporary stations, distributed in a roughly 10 km by 
10 km grid, termed the Distributed Regional Aerosol Grid- 
ded Observation Networks (DRAGON). This network pro- 
vided an unprecedented opportunity to validate satellite de- 
rived aerosol properties at a high spatial resolution. Each sta- 
tion is equipped with a Cimel sun photometer (SP) measuring 
at eight spectral bands between 340 nm and 1020 nm. AOD 
is calculated at 550 nm using a quadratic log-log fit (Eck et 
al., 1999). The AOD retrieval is expected to be accurate to 
within ±0.015 (Eck et al., 1999; Schmid et al., 1999). 

In this work, we use the level 1.5 AERONET/DRAGON 
SP data, which are cloud screened (Smirnov et al., 2000) but 
not quality controlled. However, comparisons between level 
1.5 and level 2.0 AOD have a correlation of 0.99, a slope of 1 
and no offset, and the level 1.5 data contains more measure- 
ments. 

3.3 High Spectral Resolution LIDAR (HSRL) 

The NASA Langley Research Center airborne HSRL in- 
strument calculates aerosol optical depth at 532 nm using 
independent measurements of vertically resolved aerosol 
backscatter and extinction, and is therefore expected to be 
more accurate than a standard backscatter lidar, which typi- 
cally requires additional data and/or assumptions to produce 
extinction profiles, and therefore AOD, from the backscatter 
(Hair et al., 2008). The NASA Langley King Air B200 air- 
plane flew 25 flights with the HSRL instrument aboard on 13 
days between 1 July 201 1 and 29 July 2011. 

4 Results 
4.1 Case studies 

Because much of the value of the 3 km resolution retrieval is 
better at resolving smaller scale aerosol features, we first look 
at two case studies from differing days in the D1SCOVER- 
AQ study. Figure 1 shows the 10 km (panels a and c) and 
3 km (panels b and d) resolution MODIS AOD at 0.55 pm 
observed by MODIS-Aqua on 21 July 2011 at 18:30 UTC. 
On this day, there is a strong AOD gradient, with a change 
from 0.15 to 0.45 AOD over "-50 km, and a local AOD en- 
hancement reaching to over 0.75. HYSPLIT back trajecto- 
ries, using winds from the NAM model at 12 km resolution, 
show that the lower AOD air mass originated in the Midwest- 
ern United States, while the higher AOD air mass was com- 
ing from southern Virginia and North Carolina, which had 
active biomass burning nearby, and also passed over more 
urbanized regions. The two MODIS products both resolve 
the AOD gradient, and, in general, show the same aerosol 
situation. Both products resolve the SP measured AOD max- 
imum of 0.75, although the 3 km product shows more high 
AOD pixels which may or may not be noise. The 3 km prod- 
uct is able to retrieve closer to clouds, and therefore shows 
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(a) 10 km resolution, single pixel 



(b) 3 km resolution, single pixel 



(c) 10 km resolution, spatial average 



(d) 3 km resolution, spatial average 
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Fig. 1 . AOD at 0.55 |im observed by MODIS-Aqua on 21 July 2011 at 18:30 UTC is plotted at the 10km resolution (a and c) and 3km 
resolution (b and d). MODIS/SP collocations are plotted in the circles. In (a-d), the inner circle is the SP temporally averaged AOD, which 
is an average of > 2 SP measurements within 30 min of MODIS overpass. In (a) and (b), the outside circle is the AOD of the MODIS pixel 
containing the SP site. In (c) and (d), the outer circle is the spatial average of a MODIS AOD in a 5 x 5 pixel box around the SP station. Only 
land pixels with a QA= 3 are used in the collocation. Washington D.C. is shown with the large black star and Baltimore, MD is shown with 
the small black star. The true color image, created from the MODIS red, green and blue bands, is shown in the background. 


more detail and retrieves more area than the 10 km product. 
The 3 km product is also able to retrieve over bodies of wa- 
ter which are too narrow for 10 km retrievals, and has more 
pixels near the coastline that are unable to be retrieved by 
the 10 km product. The ability to retrieve closer to coastline 
is particularly valuable for air quality applications because 
many major cities, including some of the largest and most 
polluted, are located on coasts. This granule not only high- 
lights the value of a high resolution satellite product, but also 
shows that AOD can vary significantly over small distances. 

Plotted overtop of the MODIS AOD images in the circles 
are MODIS/SP collocations. In all of the panels (a-d), the 
inner circle shows the SP temporal mean, which is calcu- 
lated by averaging all SP 0.55 pm AOD measurements at a 
station within 30 min of the MODIS overpass time, with a 
minimum of 2 observations. In the top row (panels a and b), 
the outer circle shows the 0.55 pm AOD of the MODIS pixel 


in which the SP station is located. In the bottom row (pan- 
els c and d), the outer circle shows the MODIS spatial mean, 
which is calculated by averaging all high quality (QA = 3) 
land pixels within a 5 pixel by 5 pixel box surrounding the 
SP station requiring at least 5 out of a possible 25 pixels 
(Ichoku et al., 2002). Therefore, the spatial averaging box 
for the 3 km product is 15 km by 15 km, and the spatial aver- 
aging box for the 10 km product is 50 km by 50 km. The sin- 
gle pixel MODIS collocations in the top row show excellent 
agreement between the MODIS retrieval and the SP mea- 
surements for both the 10 and 3 km products. However, the 
MODIS spatial average shown in the bottom row gives the 
impression that the 10 and 3 km products provide different 
answers; in this case, the smaller averaging box creates better 
MODIS/SP agreement for the 3 km product, while the larger 
averaging box of the 10 km product smoothes out the gradi- 
ent and causes disagreement. The spatial averaging technique 


Atmos. Meas. Tech., 6, 1747-1759, 2013 


www.atmos-meas-tech.net/6/1747/2013/ 





L. A. Munchak et al. : MODIS 3 km aerosol product: applications over land 


1751 



(a) 10 km resolution, single pixel 



(b) 3 km resolution, single pixel 



AOD at 0.55 pm 


-0.05 0.05 0.15 0.25 0.35 0.45 0.55 0.65 0.75 


Fig. 2. AOD at 0.55 pm observed by MODIS-Terra on 1 July 2011 at 15:35UTC is plotted at the 10km resolution (a and c) and 3km 
resolution (b and d). MODIS/SP collocations are plotted in the circles. In (a-d), the inner circle is the SP temporally averaged AOD, which 
is average of >2SP measurements within 30 min of MODIS overpass. In (a) and (b), the outside circle is the AOD of the MODIS pixel 
containing the SP site. In (c) and (d), the outer circle is the spatial average of a MODIS AOD in a 5 x 5 pixel box around the SP station. Only 
land pixels with a QA= 3 are used in the collocation. Washington D.C. is shown with the large black star and Baltimore, MD is shown with 
the small black star. The tme color image, created from the MODIS red, green and blue bands, is shown in the background. 


does increase the number of MODIS-SP collocations as com- 
pared to the single pixel technique, adding an extra collo- 
cation for each product. This granule shows that the single 
pixel collocation technique better characterizes AOD at the 
SP site, but limits the number of collocations and therefore 
the statistical robustness of the validation. 

Figure 2 shows the 10 km and 3 km resolution MODIS 
AOD observed by MODIS-Terra on 1 July 2011 at 
15:35 UTC, which has a markedly different aerosol distri- 
bution than that shown in Fig. 1. On this day, AOD is low 
(0.12 as measured by the SPs) and is homogeneous across 
the region. As in Fig. 1, the large-scale view of the two 
MODIS products agree, but there are nuanced differences. 
Some noisy pixels are present in the 3 km product, and are 
less apparent in the 10 km product. Both the 10 km and 
3 km products have elevated AOD along the New Jersey and 
Delaware coastline, which are plausibly cloud contaminated 


from subpixel clouds. The 10 km has fewer contaminated 
pixels, but they extend further from the coastline; the 3 km 
product has more contaminated pixels, but their spatial ex- 
tent is limited to right along the coastline. The 3 km product 
also shows a small amount of striping that results from dif- 
ferences in the MODIS instrument detectors. As in Fig. 1, the 
3 km product has more coverage over the water areas in this 
scene. The MODIS/SP collocation circles are as they were in 
Fig. 1, with MODIS single pixel collocations shown in the 
outer circles of the top row, MODIS spatial average colloca- 
tions in the outer circles of the bottom row, and SP temporal 
averages in the inner circle of all panels. 

In this aerosol situation, the spatial averaging of the 10 km 
product AOD increases the agreement with the SP measure- 
ments because the averaging decreases the impact of noisy 
pixels. Twenty-eight out of the 31 collocations shown in 
Fig. 2c fall within expected error, and the average retrieved 
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0.55 pm AOD at the SP stations is 0.15, only 0.03 higher than 
the SP determined AOD. The MODIS 3 km spatially aver- 
aged collocations show an AOD enhancement of 0.1 to 0.3 
over Baltimore City that is not observed by the SP measure- 
ments; 9 out of the 26 MODIS 3 km spatial averages shown 
in Fig. 2d have an above expected error. The largest differ- 
ence between the MODIS 3 km and SP measurements was 
observed at the sun photometer station in Essex, Maryland, 
13 km east of downtown Baltimore, where the SP AOD is 
0.11, and the AOD of the 3 km spatial average is 0.38. A 
similar AOD enhancement is seen over Washington D.C., al- 
though there are no SP measurements to confirm that this 
enhancement is a retrieval artifact. The single MODIS pixel 
collocations in the Fig. 2b do not capture this important re- 
trieval problem due to the coincidences of where the SP sta- 
tions happen to be located and if the exact pixel where the 
station is located is retrieved. This case study suggests that 
the spatial average collocation technique better character- 
izes the retrieval performance over the larger region, and the 
single pixel collocation technique may misrepresent product 
performance because it is much more sensitive to the siting 
of the SP stations. 

The airborne HSRL measurements provide an opportu- 
nity to look at aerosol extinction and AOD spatial variabil- 
ity with a nominal 1 min resolution, which corresponds to 
a nearly 6 km horizontal resolution. Figure 3 shows an- 
other high aerosol loading day, observed by MODIS-Terra 
on 29 July 2011 at 16:00 UTC. HSRL 532 nm columnar AOD 
along the flight track between 15:30 and 16:30 UTC is shown 
in the thick line, plotted atop of the 3 km resolution 0.55 pm 
AOD. The sections of the flight track where the plane was 
flying lower than 7 km, flying above clouds, or was turn- 
ing are shown in grey. SP AOD interpolated to 0.55 pm is 
shown in the circles. The SP measurements are not tem- 
porally averaged; the nearest measurement to 16:00 UTC is 
used, provided the measurement was taken between 15:30 
and 16:30 UTC. 

The SP AOD measurements range from 0.33 to 0.58, with 
lower values towards the south and west, and higher val- 
ues towards the north and east. The HSRL AOD measure- 
ments have a wider range from 0.35 to 0.67. There is excel- 
lent agreement between HSRL and SP measurements at the 
AERONET stations, which indicates that the broader range 
of AOD values from HSRL is likely due to the HSRL instru- 
ment being able to measure a larger area than the sun pho- 
tometers and not due to inaccuracies in either measurement. 
The MODIS 3 km product generally captures the spatial pat- 
tern of AOD as observed by both the HSRL instrument and 
the sun photometers, although as in Fig. 2, the AOD is over- 
estimated in the urban areas and there are noisy retrievals. 
Outside of the urban areas, the MODIS image shows AOD 
near 0.45 for much of the southern and western portion of 
the granule, increasing to 0.65-0.75 in the northeastern por- 
tion of the granule that also has HSRL and SP measurements. 



-0.05 0.05 0.15 0.25 0.35 0.45 0.55 0.65 0.75 


Fig. 3. A 3 km resolution AOD at 0.55 pm observed by MODIS- 
Terra on 29 July 201 1 at 16:00 UTC is plotted in the background. 
HSRL 532 nm columnar AOD along the flight track between 15:30 
and 16:30 UTC is shown in the thick line. SP AOD interpolated 
to 0.55 pm is shown in the circles. The SP measurements are not 
temporally averaged; the nearest measurement to 16:00 UTC is 
shown, provided the measurement was taken between 15:30 and 
16:30 UTC. Washington D.C. is shown with the large black star and 
Baltimore, MD is shown with the small black star. The true color 
image, created from the MODIS red, green and blue bands, is shown 
in the background. 


Overall, the three instruments show a similar aerosol situa- 
tion albeit with varying levels of detail. 

The HSRL AOD measurements reflect the more general 
pattern observed by the sun photometers, but also show many 
small-scale enhancements that cannot be observed even with 
the high spatial density of the DRAGON network. The west- 
ern portion of the flight track in Fig. 4 shows that the HSRL 
instrument measured an increase in AOD from 0.41 to 0.59 
over ~ 4 min between 16:00:08 and 16:04:28 UTC, and trav- 
eling south by 29.8 km and west by 5.3 km in this time pe- 
riod. This change takes place over three 10 km boxes and ten 
3 km boxes. The MODIS 3 km product better retrieves the ab- 
solute change in AOD, although the gradient along the flight 
track is not well reproduced because of missing and noisy 
pixels. The maximum AOD is overestimated in the 10 km 
product, and is more accurately retrieved in the 3 km prod- 
uct, although a neighboring pixel has an anomalously high 
AOD. It is probable that there is a source of contamination in 
the noisy 3 km pixel, which was included in the 10 km pixel 
along with the good pixels, resulting in an overestimation in 
the 10 km pixel. From this comparison, it is clear that while 
the 3 km product contains more noisy pixels that are likely 
contaminated, the smaller pixel size limits the spatial extent 
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(a) 10 km product 


(b) 3 km product 
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Fig. 4. Close up view of the area enclosed in the white box in Fig. 3. (a) MODIS 10 km 0.55 |im AOD with 532 nm HSRL AOD plotted on 
top. (b) MODIS 3 km 0.55 pm AOD with 532 nm HSRL AOD plotted on top. 


of the contamination and allows nearby uncontaminated pix- 
els to retrieve the correct AOD. In the 3 km product, the ef- 
fects of cloud or surface contamination are larger within a 
single pixel, but at the same time are also spatially limited. 

As highlighted in Fig. 4, because the HSRL instrument 
makes several measurements within a single MODIS pixel, it 
provides an opportunity to assess AOD variability across the 
standard MODIS retrieval resolution. A measure of subpixel 
AOD variability is shown in Fig. 5. For each 10 km resolution 
MODIS pixel, the minimum HSRL measured AOD is sub- 
tracted from the maximum HSRL AOD, provided the mea- 
surements are within half an hour of the MODIS overpass. 
Data from all flights that have valid data within half an hour 
of a MODIS overpass are included, and only MODIS pix- 
els that contain more than 5 HSRL observations are ana- 
lyzed to ensure that two fully independent HSRL measure- 
ments are obtained within the MODIS pixel. In all, 482 
MODIS pixels are available for analysis for subpixel AOD 
variations. Within a single MODIS 10 km pixel, the maxi- 
mum HSRL measured AOD change is 0.25, increasing from 
0.36 to 0.61 AOD. The mean 0.55 pm AOD variation within 
a 10 km pixel is 0.037 while the median variation within a 
10 km pixel is 0.023. Fewer than 25% of pixels contained 
less than 0.01 AOD variation. The 10 km retrieval assumes 
uniformity of the AOD across the retrieval box, and that is 
simply not the case. The assumption is likely to hold bet- 
ter across the 3 km retrieval box; however, the nominal res- 
olution of the HSRL instrument for this study is larger than 
the 3 km retrieval box. For this case, decreasing the HSRL 
nominal horizontal resolution for AOD from 6 km to 1 km 
increased the noise to an unacceptably high level such that 



HSRL AOD Range 

Fig. 5. The maximum difference between HSRL 0.55 pm AOD 
measurements observed within a MODIS 10 km pixel, normalized 
by the total number of analyzed grid boxes. Only MODIS pixels 
that contain 6 or more HSRL measurements are included. 


the AOD variation within the MODIS 3 km pixels could not 
be quantified. 

The case study comparisons with ground- and airborne- 
based AOD measurements show that the MODIS 3 km prod- 
uct contains additional aerosol information as compared to 
the 10 km product. Figure 1 shows a situation in which a few 
high AOD pixels in the 10 km product could be interpreted 
as noise, but the higher resolution of the 3 km product pro- 
vides many more pixels, and SP data confirms that a true high 
aerosol loading event was identified. Additionally, the 3 km 
retrieval is able to retrieve over small bodies of water and 
close to coastline. The subpixel AOD variability observed 
by HSRL suggests that a 10 km product will frequently miss 
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(a) Single pixel - 10 km 


(b) Single pixel - 3 km 



(c) Single pixel 
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(f) Spatial average 
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Fig. 6. (a) Density scatter plot of MODIS/SP collocations for 10 km AOD at 0.55 pm, using the single pixel collocation technique. Expected 
error over land (±0.05 ± 0.15 AOD) is shown in the dashed lines, the best fit line is shown by the solid blue line, and the one-to-one line is 
shown in the solid black line, (b) Same as in (a), except for the 3 km product, (c) Average difference between MODIS single pixel collocations 
and SP 0.55 pm AOD, as a function of SP 0.55 pm AOD. A standard deviation of ± 1 is shown for the 3 km product, (d-f) As in (a-c), except 
the MODIS 5x5 pixel spatial average collocation is used. 


small changes in AOD over an urban/suburban region. How- 
ever, retrieving with a higher resolution reduces the statistical 
robustness of the aerosol product, resulting in more noise and 
inaccurate retrievals over urban areas. 

4.2 MODIS 3 km validation 

The case studies highlight the strengths and weaknesses of 
the 3 km product; however, the sun photometer data from the 
entire campaign provides the most comprehensive dataset to 
characterize its performance. The SP data also allows a crit- 
ical look at how the different collocation techniques demon- 
strated in Figs. 1 and 2 lead to different conclusions on the 
validity on the MODIS AOD data in this region for both the 
10 and 3 km resolutions. 

In Fig. 6a, all 10km MODIS/SP 0.55 pm AOD colloca- 
tions are shown in a density scatter plot, using the MODIS 
single pixel collocation technique employed in Figs, la and 
2a, and the same is shown in Fig. 6b for the 3 km product. In 
Fig. 6c, these single pixel MODIS/SP collocations are binned 
by the SP AOD, and the mean MOD1S-SP difference for the 
bin is plotted for both the 10 and 3 km products. This process 
is repeated in Fig. 6d-f except that the 5x5 pixel MODIS 
spatial collocation technique is employed in the MODIS/SP 


collocations. The collocation statistics for both techniques 
for both products is shown in Table 1 . 

For both MODIS/SP collocation techniques, the bulk of 
the 3 km MODIS retrievals are within the ±0.05 ±0.15 AOD 
expected error (63.6% for the single pixel technique and 
68 % for the spatial average technique). The satellite retrieval 
is highly correlated with the ground-based measurements, 
although with a small negative offset (0.011 for the single 
pixel technique and 0.013 for the spatial average technique) 
and a significant slope (1.26 for single pixel, 1.22 for spatial 
average). Accordingly, the MODIS 3 km AOD agrees well 
with SP AOD at low aerosol loadings, but is generally biased 
high at higher AOD. The primary difference between the two 
collocation techniques is that the spatial average has nearly 
twice as many collocations (817 as opposed to 451, for the 
3 km product); therefore, the spatial averaging technique may 
be more representative of the region at large. 

The binned MODIS-SP differences in Fig. 6c and f agree 
well with the impression given by the scatter plots. The bias 
of the MODIS 3 km product is near zero at AOD below 0.1, 
then is biased high above 0.1. The single pixel collocation is 
likely to best compare the 10 km and 3 km products, because 
the spatial averaging technique samples a different area for 
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Table 1. Statistics from the 4 different MODIS/SP collocations shown in Fig. 6a, b and d-e. N =number of valid collocations, R = correlation 
coefficient, Slope = slope of regression line (shown in blue in Fig. 6), Offset = y intercept of the regression line, bias = MODIS average AOD 
minus SP average AOD, RMSE = root mean square error of collocations. EE for all cases is ±0.05 ± 0.15 AOD. 


Product 

resolution 

Averaging 

method 

N 

R 

Slope 

Offset 

Bias 

RMSE 

% above 
EE 

% within 
EE 

% below 
EE 

10 km 

single pixel 

499 

0.925 

1.235 

0.004 

0.049 

0.093 

26.7 

69.3 

4.0 

10 km 

spatial average 

848 

0.935 

1.134 

0.008 

0.039 

0.075 

21.5 

75.9 

2.6 

3 km 

single pixel 

451 

0.914 

1.263 

0.011 

0.062 

0.109 

33.7 

63.6 

2.7 

3 km 

spatial average 

817 

0.928 

1.228 

0.013 

0.057 

0.096 

30.7 

68.0 

1.3 


(a) 10 km resolution 
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(b) 3 km resolution 
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Fig. 7. Density scatter plot of MODIS/HSRL collocations for AOD at 0.55 pm for MODIS and 532 nm for HSRL for the 10 km MODIS 
product (a) and the 3 km MODIS product (b). The MODIS AOD is sampled along the HSRL flight path; no spatial or temporal averaging is 
performed. Expected error over land (±0.05 ± 0. 15 AOD) is shown in the dashed lines, the best fit line is shown by the solid blue line, and 
the one-to-one line is shown in the solid black line. 


the different products. The 3 km product single pixel aver- 
ages shown in Fig. 6c show that the average AOD of the 3 km 
product is frequently, but not always, higher than the 10 km 
product. 

The retrieved AOD from the HSRL airborne instrument 
provides a different perspective on validation of the 3 km 
product. Because the plane is moving quickly in space, 
no spatial or temporal averaging is used to make the 
MODIS/HSRL collocations. The MODIS data are sampled 
along the HSRL flight track, provided that the HSRL ob- 
servation is made within the geographic region mapped in 
Figs. 1 and 2, and is within 30 min of the MODIS overpass. 
Shortening the time requirement to either 15 or 5 min does 
not significantly affect the collocation statistics, but provides 
far fewer collocations. The HSRL and MODIS AOD are not 
interpolated to the same wavelength, which is expected to 
introduce between 2M % error (Kittaka et al., 2011). It is 
expected that the AOD retrieved by the HSRL instrument 
would be lower than the AOD retrieved by MODIS by at least 
0.01 to 0.02 because the HSRL instrument does not measure 
the entire column, and therefore neglects the contribution of 
above the HSRL profile (i.e. above 7 km) to total columnar 
AOD. 


Figure 7 shows that the both products agree with HSRL, 
but with significant high bias (0.093 for 10 km, 0.086 for 
3 km). The increased bias of the 10 km product could be 
due to the pixel contamination effect shown in Fig. 4 - al- 
though the 3 km product contains more contaminated pixels, 
the spatial extent of those pixels is limited, allowing more 
correct pixels as well. The 10 km MODIS/HSRL comparison 
also shows the necessity of a higher resolution retrieval; the 
stripes in the HSRL/MOD1S comparison show the change in 
HSRL AOD within a single pixel; the pattern that is quanti- 
fied in Fig. 5. 

From both SP and HSRL comparisons, we consider the 
3 km product to be validated in this region. Using either 
collocation technique, more than 63 % of MODIS/SP col- 
locations are within the expected error of the 10 km prod- 
uct, which is more stringent than the defined EE of the 3 
km product. If the more lax ±0.05 ± 0.20 AOD expected er- 
ror definition for the 3 km product (Remer et al., 2013) is 
employed, then the percent of collocations within EE in- 
creases to 67. 1 % for the single pixel collocation technique, 
and 73.1% for the spatial collocation technique. However, 
the increased noise and urban problems give the 3 km product 
a larger high bias than the 10 km product as compared to SP 
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Fig. 8. (a) Percent of 3 km spatially averaged MODIS/SP collocations of 0.55 pm AOD within expected error (±0.05 ± 0.15 AOD) at each 
SP station, (b) Correlation coefficient between 3 km spatially averaged MODIS 0.55 pm AOD and SP temporally averaged 0.55 pm measure- 
ments at each station. Land identified as urban/built up by the MODIS land cover product (MCD12Q1) is plotted in grey in both panels. 


measurements. The single pixel and spatial average MODIS 
collocation techniques show quantitative but not qualitative 
differences. 

4.3 Sources of uncertainty 

Figures 2 and 3 show an overestimation of AOD in urban 
areas. In order to study this further, we separate the 3 km 
MODIS/SP spatially averaged collocations by SP station, 
and compute agreement statistics for each station. We choose 
the spatial averaging collocation technique because it pro- 
vides more collocations. The percent of comparisons within 
expected error for each station is shown in Fig. 8a, and the 
correlation coefficient ( R ) between MODIS and SP 0.55 pm 
AOD is shown in Fig. 8b. In each panel, land classified as “ur- 
ban” by the MODIS Land Cover type product (MCD12Q1) 
is plotted in grey. 

Figure 8a shows remarkable variability in the percent of 
collocations within EE for each SP station, ranging between 
16% to 95%. The stations with the smallest percent within 
EE are clustered around the Baltimore urban center, and 
the more urbanized 1-95 corridor between Washington D.C. 
and Baltimore. However, the stations with small percentages 
of collocations within EE still have correlation coefficients 
above 0.85, suggesting that the error is a systematic bias that 
could be accounted for in future retrievals, and not a random 
error. 

We wish to quantify the urban overestimation of the 3 km 
product using the dense spatial distribution of the sun pho- 
tometer sites in the DRAGON network. Using the same 
15 km averaging box as the MODIS spatial collocation, the 
percent of pixels within the averaging box identified as ur- 
ban by the MCD12Q1 product is calculated. In Fig. 9, this 
quantity is plotted against the percent of collocations above 
EE for each SP site. The percent of urban land within the 
MODIS averaging box is well correlated with the percent 



Urban landcover percentage 


Fig. 9. Percent of 3 km spatially averaged MODIS/SP 0.55 pm AOD 
collocations above expected error (±0.05 + 0.15 AOD) at each SP 
station, plotted against the percentage of pixels within the 15 km by 
15 km collocation box identified as urban by the MODIS land cover 
product. 

of MODIS/SP collocations that are above the expected er- 
ror. This confirms that the largest source of uncertainty in 
this study is related to the urban areas. The cause is sus- 
pected to be improper land surface reflectance characteri- 
zation, considering that aerosol sources are not expected to 
vary significantly within the region of study and that it has 
been shown that the surface reflectance in the 0.66 pm chan- 
nel over some urban surfaces is ~ 0.7 of the 2.13 reflectance 
(Castanho et al., 2008; Oo et al., 2010) which is higher than 
the ratio used in the MODIS operational retrievals. In mixed- 
use urban/suburban regions like the D1SCOVER-AQ study 
region, it is likely that the brighter urban surface 500 m pix- 
els were selectively discarded in the pixel selection process 
of the 10 km product. However, because the resolution of the 
3 km retrieval is smaller, more urban pixels remain within 
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(a) 21 July 2011, 18:30 UTC 



(b) 01 July 2011, 15:35 UTC 


AOD at 2.1 pm 

-0.05 0.00 0.05 0.10 0.15 0.20 0.25 0.30 0.35 

Fig. 10. (a) 3 km AOD at 2.1 pm observed by MODIS-Aqua on 21 July 2011 at 18:30 UTC. (b) 3 km AOD at 2.1 pm observed by MODIS- 
Terra on 1 July 2011 at 15:35 UTC. Only land pixels with a QA = 3 are shown. Washington D.C. is shown with the large black star and 
Baltimore is shown with the small black star. The true color image, created from the MODIS red, green and blue bands, is shown in the 
background. 


the retrieval box after pixel selection, causing the surface 
reflectance in the visible wavelengths to be underestimated, 
leading to an overestimation in AOD. 

Ideally, the noisy pixels could be flagged as poor quality, 
and therefore treated with some degree of caution. One of 
the products produced operationally is the AOD at 2. 1 pm. 
This is not a validated product, but is used as a diagnos- 
tic to the retrieval. It may hold information that can identify 
poorer quality 3 km retrievals. In Fig. 10a, the 2.1 pm AOD 
on 21 July 2011 at 18:30 from the 3 km product is plotted, 
the same granule as that shown in Fig. lb, and in Fig. 10b; 
the 2.1 pm AOD on 1 July 2011 at 15:35 UTC from the 3 km 
product is plotted, the same granule as that shown in Fig. 2b. 
The scene-wide 2.1 pm AOD is 0.046 in the left panel, and 
is 0.065 in the right panel. Both granules contain pixels with 
a 2.1 pm AOD over 0.2, more than 3 to 5 times higher than 
the scene-wide average. The error is not due to the wrong 
aerosol model being picked; in both scenes, all of the pix- 
els were assigned the fine mode dominated urban aerosol 
model (Levy et al., 2007a). It appears that the same pix- 
els that have anomalously high 2.1 pm AOD retrievals also 
tend to have inaccurate 0.55 pm AOD retrievals. For exam- 
ple, the pixels with high (> 0.55) AOD in Fig. lb that agree 
with SP observations have retrieved 2.1 pm AOD values that 
do not stand out from the background. However, the pixels 
with high AOD in Fig. 2b that do not agree with SP observa- 
tions have retrieved 2.1 pm AOD values significantly higher 
than the background. Although the 2.1 pm AOD retrieval is 
an unvalidated product, it may serve a purpose as a consis- 
tency check in this fine mode dominated, urban environment. 
This consistency check is likely to be inapplicable in dusty or 
other coarse mode dominated regimes. 


Using anomalous 2.1 pm AOD pixels as a proxy for poor 
quality 0.55 pm pixels, and therefore throwing them out, re- 
sults in a reduction of the both the negative bias at low AOD 
and the positive bias at high AOD. If the 3 km product is 
filtered such that pixels with a 2.1 pm AOD over 0.2 are ex- 
cluded, and MODIS/SP are collocated using the spatial av- 
eraging technique, the percent within EE rises from 68 % to 
78 %, while the number of collocations falls from 817 to 727, 
and the R rises from 0.92 to 0.95. However, this screening 
is not globally applicable, and is not recommended for use 
without closer examination. 

It appears that a primary source of error in the 3 km 
MODIS aerosol product is the incorrect estimation of surface 
reflectance over urban regions. This error is not as apparent in 
the 10 km product because brighter urban surfaces are pref- 
erentially discarded during the pixel selection process. How- 
ever, because the 3 km product has a smaller footprint, it is 
likely that not all urban pixels are discarded, and the surface 
reflectance is underestimated, leading to an overestimation in 
AOD. The 2. 1 pm AOD shows some potential as an imperfect 
filter for these poor quality pixels. 


5 Summary and conclusions 

The MODIS dark target aerosol algorithms were designed 
with climate applications in mind, and the spatial scale of 
the retrieval reflects that design. However, as the applica- 
tions of the aerosol product have evolved, the proper scale at 
which to observe small-scale aerosol events came into ques- 
tion. In response to the needs for aerosol observations at a 
higher resolution than 10 km, an operational aerosol product 
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produced at a 3 km resolution will be available in MODIS 
Collection 6. 

This new product was evaluated against ground and air- 
borne data over the Baltimore- Washington D.C., USA cor- 
ridor over the summer of 2011 to understand the poten- 
tial added information from the higher resolution retrieval 
and the statistical reliability of the product. The 10 km and 
3 km granules generally resolve similar large scale patterns in 
aerosol distribution but differ in the details. The smaller foot- 
print of the 3 km product retrieves closer to clouds and over 
small bodies of water, but also makes the product more sus- 
ceptible to cloud contamination and other sources of noise. 
Subpixel comparisons against HSRL show that AOD can 
vary significantly within a 10 km pixel, and a 3 km resolution 
is a more appropriate scale for studying aerosol distributions 
in urban and suburban settings. 

The dense network of sun photometers deployed during 
the DISCOVER-AQ campaign provided an unprecedented 
opportunity to validate aerosol products at a high spatial 
scale. Given the new resolution of both the satellite data and 
the ground validation network, the MODIS spatial-temporal 
collocation techniques for validation were revisited. It was 
found that using a spatial average of MODIS pixels around a 
sun photometer station, or using only the pixel where the SP 
station is located resulted in a quantitative, but not qualita- 
tive, difference. We conclude with good confidence that the 
MODIS 3 km validates in this region, but is biased high at 
AOD values greater than 0.1. 

There is evidence that a significant source of the bias ob- 
served in the 3 km product results from improper characteri- 
zation of urban surfaces. The method for attributing the sur- 
face contributions to TOA measured reflectances has been 
documented to underestimate the surface reflectances in ur- 
ban areas (Castanho et al., 2008; Oo et al., 2010), which 
in turn overestimates AOD. Indeed, we found a strong cor- 
relation between the amount of urban surface near a sun 
photometer station, and the percent of collocations that are 
above the expected error. While case studies show that the 
10 km product also has one or two pixels that are affected, 
the smaller pixel size of the 3 km product causes it to be more 
susceptible to contamination. 

The poor performance of the 3 km product over urban sur- 
faces is clearly a limitation in terms of air quality applica- 
tions. How to best address this problem in an operational en- 
vironment remains an open question. However, despite this 
limitation, the 3 km aerosol product has new capabilities for 
studying aerosol on local scales, including resolving small 
scale AOD gradients and point sources, retrieving aerosol 
in patchy cloud fields, and retrieving closer to coastlines. 
We expect that the added information of the 3 km resolution 
product will complement the existing MODIS 10 km reso- 
lution aerosol product and products from other passive and 
active sensors to provide a more complete view of global 
aerosol properties from space. 
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Abstract 

MODerate resolution Imaging Spectroradiometer (MODIS) instruments aboard the 
Terra and Aqua satellites have provided a rich dataset of aerosol information at a 1 0 km 
spatial scale. Although originally intended for climate applications, the air quality com- 
5 munity quickly became interested in using the MODIS aerosol data. However, 10 km 
resolution is not sufficient to resolve local scale aerosol features. With this in mind, 
MODIS Collection 6 is including a global aerosol product with a 3 km resolution. Here, 
we evaluate the 3 km product over the Baltimore/Washington D.C., USA, corridor dur- 
ing the summer of 201 1 , by comparing with spatially dense data collected as part of the 
io DISCOVER-AQ campaign; these data were measured by the NASA Langley Research 
Center airborne High Spectral Resolution Lidar (HSRL) and a network of 44 sun pho- 
tometers (SP) spaced approximately 10 km apart. The HSRL instrument shows that 
AOD can vary by up to 0.2 within a single 10 km MODIS pixel, meaning that higher res- 
olution satellite retrievals may help to characterize aerosol spatial distributions in this 
is region. Different techniques for validating a high-resolution aerosol product against SP 
measurements are considered. Although the 1 0 km product is more statistically reliable 
than the 3 km product, the 3 km product still performs acceptably, with more than two- 
thirds of MODIS/SP collocations falling within the expected error envelope with high 
correlation (/?>0.90). The 3 km product can better resolve aerosol gradients and re- 
20 trieve closer to clouds and shorelines than the 1 0 km product, but tends to show more 
significant noise especially in urban areas. This urban degradation is quantified using 
ancillary land cover data. Overall, we show that the MODIS 3 km product adds new 
information to the existing set of satellite derived aerosol products and validates well 
over the region, but due to noise and problems in urban areas, should be treated with 
25 some degree of caution. 
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1 Introduction 

For over twelve years, the MODerate resolution Imaging Spectroradiometer (MODIS) 
instruments, flying aboard the Terra and Aqua satellites, have been collecting data on 
the global distribution of climate related variables. Several of these variables describe 
5 aerosols, which have been shown to be one of the largest sources of uncertainty in 
the climate system (IPCC, 2007). MODIS provides a suite of information about aerosol 
properties, including aerosol optical depth (AOD) and aerosol sizing parameters, that 
have been used extensively for climate studies (e.g. Kaufman et al., 2002; Bellouin 
et al., 2005; Quaas et al., 2008). Currently, three algorithms are used operationally to 
io provide products to the public - the dark target algorithm over land (Kaufman et al., 
1997a; Levy et al., 2007b, 2010), the dark target algorithm over ocean (Tanre et al., 
1997; Remer et al., 2005, 2008) and the deep blue algorithm over land (Hsu et al., 
2004, 2006). All produce data at a 1 0 km nominal spatial scale, which is an appropriate 
scale for climate studies (Remer et al., 2013). 
is Soon after launch, it was realized that the retrieved aerosol parameters could be 
used as proxies for estimating surface air quality conditions (e.g Hutchison, 2003; 
Wang and Christopher, 2003; Chu et al., 2003; Engels-Cox et al., 2004; Hutchison 
et al., 2005). The MODIS instruments are particularly appealing for air quality applica- 
tions because the broad (2330 km) swath of the instrument allows most global locations 
20 to be monitored on a nearly daily basis. However, the 10 km resolution of the MODIS 
aerosol products is insufficient to resolve small-scale features relevant to local air qual- 
ity, including point sources in urban areas (C. C. Li et al., 2005) and small fire plumes 
(Lyapustin et al., 2011). Although several research techniques exist to retrieve aerosols 
at higher spatial scales (1 00 m to 1 km) from MODIS observations (e.g., Li et al., 201 2; 
25 Lyapustin et al., 2011), they have not been produced globally in an operational envi- 
ronment. 

In response to requests from the air quality community, MODIS Collection 6 will 
include a global aerosol product at nominal 3 km scale, in addition to the standard 
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10 km resolution. This 3 km product will include retrievals based on both dark target 
algorithms (land and ocean). Remer et al. (2013), describe the 3 km product in detail, 
and analyzed a six-month test database to compare the performance of the 3 km and 
10 km products on a global scale. The 3 km product can show more spatial detail than 
s the 1 0 km product, but agrees less well with ground based sun photometers on a global 
scale. Accordingly, the 10 km product is still the best choice for studies concerning 
aerosol effects on climate. However, the 3 km product may be better at characterizing 
aerosol distributions on local scales, and can only be tested by comparing to dense 
observations on a small spatial scale. We wish to examine the 3 km aerosol product 
io on a regional scale to determine the additional information content that the higher 
resolution retrieval provides, and the possible degradation in data quality introduced 
by moving to a higher resolution. 

In this work, we focus primarily on AOD, because it has been used for surface air 
quality applications (van Donkelaar et al., 2006), and can easily be compared with 
is sunphotometer data. Specifically, we can evaluate AOD products at both 10 km and 
3 km resolutions by comparing with surface and airborne-based AOD measurements 
collected during the DISCOVER-AQ field campaign conducted during the summer of 
201 1 over the Baltimore-Washington D.C. corridor of the United States. We first assess 
the similarities and differences in 10 km and 3 km MODIS AOD images, and evaluate 
20 whether the 3 km product provides information that is not captured by the 1 0 km prod- 
uct. We look critically at the best method to validate the higher resolution aerosol re- 
trieval against sun photometer measurements, and validate the 10 km and 3 km prod- 
ucts for the campaign duration. The ability of the MODIS product at both 10 km and 
3 km resolutions to capture spatial variability in AOD is also addressed. Due to the lim- 
25 ited validation data for the over ocean variables, we will only address the land variables 
in this study. 
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2 The MODIS 3 km land algorithm 

The retrieval method of the global MODIS 3 km aerosol product is thoroughly detailed 
in Remer et al. (2013). For the sake of completeness, we will briefly describe the land 
algorithm here. The 3 km algorithm emerges from the “dark target” retrieval methodol- 
s ogy (Kaufman et al., 1997a; Tanre et al., 1997; Remer et al., 2005; Levy et al., 2007b, 
2013), based on the concept that in the visible wavelengths, aerosols are bright and 
vegetated surfaces tend to be dark. The spectral contrast between aerosols and the 
surface can be used to retrieve quantitative information about aerosol properties. 

To increase signal-to-noise, the MODIS algorithm retrieves aerosol parameters at 
io a lower spatial resolution than the nominal (at nadir) 500 m top of atmosphere (TOA) 
reflectance measurements. The algorithm creates N by N “retrieval boxes” of pixels, 
in order to filter out the subset that is not desirable for aerosol retrieval. Thus, the 
10 km algorithm works with 20 x 20 pixel retrieval boxes (400 pixels), whereas the 3 km 
algorithm works with 6x6 pixel retrieval boxes (36 pixels). Remer et al. (2013) describes 
is how pixels are masked for cloud (Martins et al., 2002), sediments in water (Li et al., 
2003), snow and ice (R. Li et al., 2005) and surfaces that are too bright for retrieval. 
The remaining pixels are sorted by their 0.66 pm reflectance, and the brightest 50% 
and darkest 20% of the remaining pixels are discarded. This means that in the 10 km 
(3 km) algorithm, there are at most 120 pixels (11 pixels) remaining from which to do 
20 aerosol retrieval. The reflectances of these remaining pixels are averaged, resulting 
in on set of spectral reflectance values to drive the aerosol retrieval. These spectral 
reflectance values are further “corrected” for gas absorption (e.g. Levy et al., 2013). 

The expected “quality” of the retrieval is determined by the number of pixels that 
remain after all masking and filtering. If at least 51 pixels remain (out of 120) for 10 km 
25 or 5 pixels remain (out of 1 1 ) for 3 km, then the retrieval is initially expected to be “high” 
quality. The 10 km retrieval will be attempted if only 12 pixels remain (out of 120), but 
it is expected to be low quality. There is no corresponding low quality attempt for the 

3 km retrieval (Remer et al., 201 3). 
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The over land algorithm performs the retrieval by matching the observed TOA spec- 
tral reflectance with lookup tables of pre-computed TOA spectral reflectance. The 
largest uncertainty is in characterizing the contribution of the surface to the TOA re- 
flectance, for which errors of 0.01 can lead to errors of 0.1 in retrieved AOD. However, 
5 Kaufman et al. (1997b) showed that the surface contribution in the 0.47 and 0.66 pm 
bands can be related to surface contribution in the 2.1 pm shortwave-IR (SWIR) band. 
The assumed relationship between the visible and SWIR was refined by Levy et 
al. (2007b), and is used as a constraint in the aerosol retrieval. As described by Levy 
et al. (2007b), the current retrieval uses the three channels (0.47 pm, 0.66 pm, and 
io 2.1 pm) to determine both the amount of aerosol (total AOD) and the relative ratio of 
fine and coarse aerosol models. The selection of the fine and coarse aerosol models 
are prescribed by season and location. The resulting primary retrieved aerosol parame- 
ters over land are total AOD at 0.55 pm, the fractional contribution of the fine-dominated 
aerosol type, the constrained surface reflectance, and fitting error (Levy et al., 2013). 
is All of these assumptions (aerosol lookup tables, assumed surface reflectance relation- 
ship, and methodology of the inversion) are identical for both 10 km and 3 km retrievals 
(e.g. Levy et al., 2013; Remer et al., 2013). 

Previously, the MODIS 10 km product has been thoroughly evaluated against sun 
photometers on global scales. The global expected error (EE) of the 10 km AOD at 
20 0.55 pm product over land is 0.05 ±0.1 5 AOD (Remer et al., 2005), and a testbed 
of 10 km data produced with the Collection 6 MODIS algorithm shows that, globally, 
70.6% of MODIS-Aqua land AOD retrievals fall within this range when collocated and 
compared to ground based sun photometer measurements (Levy et al., 2013). Re- 
mer et al. (2013) has compared the global 3 km MODIS product with sunphotometers 
25 and shown that it tends to validate less well than the 10 km. Specifically, since only 
62 % of global collocations fell within expected error over land, a new expected error of 
0.05 ± 0.25 AOD has been established for the 3 km land product (Remer et al., 2012). 
Although a new 3 km EE has been established, we choose to continue to use the more 
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stringent 10 km EE in this paper. Therefore, in this paper, when “EE” is referred to, the 
0.05 ± 0.15 AOD definition is employed. 


3 Data sources 

3.1 MODIS products 

5 This analysis uses five minute sections of the MODIS orbits, termed “granules”, col- 
lected between 20 June 201 1 to 31 July 201 1 from both the Aqua and Terra satellites. 
The level IB calibrated reflectances for Terra used in the aerosol retrieval were not 
finalized for collection 6, and may be slightly different from the operational collection 6 
level IB. However, the new calibration technique employed in MODIS Collection 6 is 
io followed in the creation of these level 1 B granules. 

Additionally, the MODIS land surface cover product (MCD12Q1) is used to charac- 
terize surface type. The land cover product uses a trained algorithm to characterize 
land surface at a 500 m resolution using 5 different classification schemes (Freidl et al., 
2010). In this work, we only consider the 17-class International Geosphere-Biosphere 
is Programme (IGBP) system (Loveland and Belward, 1997). Data from both the Terra 
and Aqua satellites is included in both the training dataset and the product. 

3.2 AERONET/DRAGON 

The AErosol RObotic NETwork (AERONET) (Holben et al., 1998) has 5 permanent 
stations operating in the study region. These stations were supplemented with an ad- 
20 ditional 39 temporary stations, distributed in a roughly 1 0 km by 1 0 km grid, termed the 
Distributed Regional Aerosol Gridded Observation Networks (DRAGON). This network 
provided an unprecedented opportunity to validate satellite derived aerosol properties 
at a high spatial resolution. Each station is equipped with a Cimel sun photometer (SP) 
measuring at eight spectral bands between 340 nm and 1020 nm. AOD is calculated at 
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550 nm using a quadratic log-log fit (Eck et al., 1999). The AOD retrieval is expected to 
be accurate to within ±0.01 5 (Eck et al., 1 999; Schmid et al., 1 999) 

In this work, we use the level 1.5 AERONET/DRAGON SP data, which are cloud 
screened (Smirnov et al., 2000) but not quality controlled. However, comparisons be- 
5 tween level 1 .5 and level 2.0 AOD have a correlation of 0.99, a slope of 1 and no offset, 
and the level 1 .5 data contains more measurements. 

3.3 High Spectral Resolution LIDAR (HSRL) 

The NASA Langley Research Center airborne HSRL instrument calculates aerosol op- 
tical depth at 532 nm using independent measurements of vertically resolved aerosol 
io backscatter and extinction, and is therefore expected to be more accurate than a stan- 
dard backscatter lidar, which typically requires additional data and/or assumptions to 
produce extinction profiles, and therefore AOD, from the backscatter (Hair et al., 2008). 
25 flights were conducted on 13 days between 1 July 2011 and 29 July 2011 on the 
NASA Langley King Air B200 airplane. 


is 4 Results 

4.1 Case studies 

Because much of the value of the 3 km resolution retrieval is in better resolving smaller 
scale aerosol features, we first look at two case studies from differing days in the 
DISCOVER-AQ study. Figure 1 shows the 10 km (panels a and c) and 3 km (panels 
20 b and d) resolution MODIS AOD at 0.55 pm observed by MODIS-Aqua on 21 July 201 1 
at 18:30 UTC. On this day, there is a strong AOD gradient, with a change from 0.15 to 
0.45 AOD over ~50km, and a local AOD enhancement reaching to over 0.75. HYS- 
PLIT back trajectories, using winds from the NAM model at 12 km resolution, shows 
that the lower AOD air mass originated in the Midwest, while the higher AOD air mass 
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was coming from southern Virginia and North Carolina, which had active biomass burn- 
ing nearby, and also passed over more urbanized regions. The two MODIS products 
both resolve the AOD gradient, and, in general, show the same aerosol situation. Both 
products resolve the SP measured AOD maximum of 0.75, although the 3 km product 
5 shows more high AOD pixels which may or may not be noise. The 3 km product is 
able to retrieve closer to clouds, and therefore shows more detail and retrieves more 
area than the 10 km product. The 3 km product is also able to retrieve over water bod- 
ies which are too narrow for 10 km retrievals, and has more pixels near the coastline 
that are unable to be retrieved by the 10 km product. The ability to retrieve closer to 
io coastline is particularly valuable for air quality applications because many major cities, 
including some of the largest and most polluted, are located on coasts. This granule 
not only highlights the value of a high resolution satellite product, but also shows that 
AOD can vary significantly over small distances. 

Plotted overtop of the MODIS AOD images in the circles are MODIS/SP collocations, 
is In all of the panels (a-d), the inner circle shows the SP temporal mean, which is cal- 
culated by averaging all SP 0.55 pm measurements at a station within 30 min of the 
MODIS overpass time, with a minimum of 2 observations. In the top row (panels a and 
b), the outer circle shows the AOD of the MODIS pixel in which the SP station is located. 
In the bottom row (panels c and d), the outer circle shows the MODIS spatial mean, 
20 which is calculated by averaging all high quality (QA = 3) land pixels within a 5 pixel by 
5 pixel box surrounding the SP station requiring at least 5 out of a possible 25 pixels 
(Ichoku et al., 2002). Therefore, the spatial averaging box for the 3 km product is 15 km 
by 15 km, and the spatial averaging box for the 10 km product is 50 km by 50 km. The 
single pixel MODIS collocations in the top row show excellent agreement between the 
25 MODIS retrieval and the SP measurements for both the 10 and 3km products. How- 
ever, the MODIS spatial average shown in the bottom row gives the impression that the 
1 0 and 3 km products provide different answers; in this case, the smaller averaging box 
data creates better MODIS/SP agreement for the 3 km product, while the larger aver- 
aging box of the 10 km product smoothes out the gradient and causes disagreement. 
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The spatial averaging does increase the number of MODIS-SP collocations as com- 
pared to the single pixel technique, adding 3 collocations for the 3 km product and 2 for 
the 1 0 km product. This granule shows that the single pixel collocation technique better 
characterizes AOD at the SP site, but limits the number of collocations and therefore 
5 the statistical robustness of the validation. 

Figure 2 shows the 10 km and 3 km resolution MODIS AOD observed by MODIS- 
Terra on 1 July 2011 at 1 5:35 UTC, which has a markedly different aerosol distribution 
than that shown in Fig. 1. On this day, AOD is low (0.1 1 as measured by the SPs) and 
is homogeneous across the region. As in Fig. 1 , the large-scale view of the two MODIS 
io products agree, but there are nuanced differences. Some noisy pixels are present in 
the 3 km product, and are less apparent in the 10 km product. Both the 1 0 km and 3 km 
products have elevated AOD along the New Jersey and Delaware coastline, which are 
plausibly cloud contaminated from sub pixel clouds. The 10 km has fewer contaminated 
pixels, but they extend further from the coastline; the 3 km product has more contam- 
15 inated pixels, but their spatial extent is limited to right along the coastline. The 3 km 
product also shows some striping that results from differences in the MODIS instru- 
ment detectors. As in Fig. 1 , the 3 km product has more coverage over the water areas 
in this scene. The MODIS/SP collocation circles are as they were in Fig. 1 , with MODIS 
single pixel collocations shown in the outer circles of the top row, MODIS spatial aver- 
20 age collocations in the outer circles of the bottom row, and SP temporal averages in 
the inner circle of all panels. 

In this aerosol situation, the spatial averaging of the 10 km product AOD increases 
the agreement with the SP measurements because the averaging decreases the im- 
pact of noisy pixels. 30 out of the 31 collocations shown in Fig. 2c fall within expected 
25 error, and the average retrieved 0.55 pm AOD at the SP stations is 0.10, only 0.01 lower 
than the SP determined AOD. The MODIS 3 km spatially averaged collocations show 
an AOD enhancement of 0.1 to 0.3 over Baltimore City that is not observed by the 
SP measurements; 6 out of the 28 MODIS 3 km spatial averages are above expected 
error. The largest difference between the MODIS 3 km retrieved AOD&SP measured 
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AOD was observed at the AERONET/DRAGON station in Essex, Maryland, 13 km east 
of downtown Baltimore, where the SP AOD is 0.11, and the AOD of the 3 km spatial 
average is 0.41. A similar AOD enhancement is seen over the Washington D.C., al- 
though there are no SP measurements to confirm that this enhancement is a retrieval 
5 artifact. The single MODIS pixel collocations in the Fig. 2b do not capture this impor- 
tant retrieval problem due to the coincidences of where the AERONET stations happen 
to be located and if the exact pixel where the station is located is retrieved. This case 
study suggests that the spatial average collocation technique better characterizes the 
retrieval performance over the larger region, and the single pixel collocation technique 
io may misrepresent product performance because it is much more sensitive to the siting 
of the SP stations. 

The airborne HSRL measurements provide an opportunity to look at aerosol extinc- 
tion and AOD spatial variability with an nominal 1 min resolution, which corresponds 
to a nearly 6 km horizontal resolution. Figure 3 shows another high aerosol loading 
is day, observed by MODIS-Terra on 29 July 201 1 at 1 6:00 UTC. HSRL 532 nm columnar 
AOD along the flight track between 15:30 and 16:30 UTC is shown in the thick line, 
plotted atop of the 3 km resolution 0.55 pm AOD. The sections of the flight track where 
the plane was flying lower than 7 km, flying above clouds, or was turning are shown in 
grey. SP AOD interpolated to 0.55 pm is shown in the circles. The AERONET measure- 
20 ments are not temporally averaged; the nearest measurement to 16:00 UTC is used, 
provided the measurement was taken between 15:30 and 16:30 UTC. 

The SP AOD measurements range from 0.33 to 0.58, with lower values towards 
the south and west, and higher values towards the north and east. The HSRL AOD 
measurements have a wider range from 0.35 to 0.67. There is excellent agreement 
25 between HSRL and SP measurements at the AERONET stations, which indicates that 
the broader range of AOD values from HSRL than from AERONET is likely due to the 
HSRL instrument being able to measure a larger area and not due to inaccuracies in 
either measurement. The MODIS 3 km product generally captures the spatial pattern of 
AOD as observed by both the HSRL instrument and the AERONET stations, although 
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as in Fig. 2, the AOD is overestimated in the urban areas and there are noisy retrievals. 
Outside of the urban areas, the MODIS image shows AOD near 0.4 for much of the 
southern and western portion of the granule, increasing for 0.65 in the northeastern 
portion of the granule that also has HSRL and SP measurements. Overall, the three 
5 instruments show a rather similar aerosol situation albeit with varying levels of detail. 

The HSRL AOD measurements reflect the more general pattern observed by 
AERONET, but also show many small-scale enhancements that cannot be observed 
even with the high spatial density of the DRAGON network. The western portion of 
the flight track in Fig. 4 shows that the HSRL instrument measured an increase in 
io AOD from 0.41 to 0.59 over ~ 4 min between 16:00:08 and 1 6:04:28 UTC, and travel- 
ing south by 29.8 km and west by 5.3 km in this time period . This change takes place 
over three 10 km boxes and ten 3 km boxes. The MODIS 3 km product successfully 
replicates the absolute change in AOD, although the gradient along the flight track is 
not exactly reproduced because of missing and noisy pixels. The maximum AOD is 
is overestimated in the 10 km product, and is retrieved exactly in the 3 km product, al- 
though a neighboring pixel has an anomalously high AOD. It is probable that there is a 
source of contamination in the noisy 3 km pixel, which was included in the 10 km pixel 
along with the good pixels, resulting in an overestimation in the 10 km pixel. From this 
comparison, it is clear that while the 3 km product contains more noisy pixels that are 
20 likely contaminated, the smaller pixel size limits the spatial extent of the contamination 
and allows nearby uncontaminated pixels to retrieve the correct AOD. In the 3 km prod- 
uct, the effects of cloud or surface contamination are larger within a single pixel, but at 
the same time are also spatially limited. 

As highlighted in Fig. 4, because the HSRL instrument makes several measure- 
25 ments within a single MODIS pixel, it provides an opportunity to assess AOD variability 
across the standard MODIS retrieval resolution. A measure of subpixel AOD variability 
is shown in Fig. 5. For each 10 km resolution MODIS pixel, the minimum HSRL mea- 
sured AOD is subtracted from the maximum HSRL AOD, provided the measurements 
are within half an hour of the MODIS overpass. Data from all flights that have valid data 
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within half an hour of a MODIS overpass are included, and only MODIS pixels that con- 
tain more than 5 HSRL observations are analyzed to ensure that two fully independent 
HSRL measurements are obtained within the MODIS pixel. 410 MODIS pixels are able 
to be analyzed for subpixel AOD variations. Within a single MODIS 10 km pixel, the 
maximum HSRL measured AOD change is 0.25, increasing from 0.36 to 0.61 AOD. The 
mean 0.55 pm AOD variation within a 10 km pixel is 0.037 while the median variation 
within a 10 km pixel is 0.023. Fewer than 25% of pixels contained less than 0.01 AOD 
variation. The 10 km retrieval assumes uniformity of the AOD across the retrieval box, 
and that is simply not the case. The assumption is likely to hold better across the 3 km 
retrieval box; however, the nominal resolution of the HSRL instrument for this study is 
larger than the 3 km retrieval box. For this case, decreasing the HSRL nominal horizon- 
tal resolution for AOD from 6 km to 1 km increased the noise to an unacceptably high 
level such that the AOD variation within the MODIS 3 km pixels could not be quantified. 

The case study comparisons with ground and airborne based AOD measurements 
show that the MODIS 3 km product contains additional aerosol information as com- 
pared to the 10 km product. Figure 1 shows a situation in which a few high AOD pix- 
els in the 10 km product could be interpreted as noise, but the higher resolution of 
the 3 km product provides many more pixels, and SP data confirms that a true high 
aerosol loading event was identified. Additionally, the 3 km retrieval is able to retrieve 
over small water bodies and close to coastline. The sub-pixel AOD variability observed 
by HSRL suggests that a 10km product will frequently miss small changes in AOD 
over an urban/suburbam region. However, retrieving with a higher resolution reduces 
the statistical robustness of the aerosol product, resulting in more noise and inaccurate 
retrievals over urban areas. 

C/)' 

O 

4.2 MODIS 3 km validation 

o' 

The case studies highlight the strengths and weaknesses of the 3 km product; however, 
the sun photometer data from the entire campaign provides the most comprehensive 
dataset to characterize the performance of the 3 km product. The SP data also allows 
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a critical look at how the different collocation techniques demonstrated in Figs. 1 and 2 
lead to different conclusions on the validity on the MODIS AOD data in this region for 
both the 10 and 3 km resolutions. 

In Fig. 6a, all 3km MODIS/SP 0.55 pm AOD collocations are shown in a density 
5 scatterplot, using the MODIS single pixel collocation technique employed in Figs. 1b 
and 2b. In Fig. 6b, these single pixel MODIS/SP collocations are binned by the SP 
AOD, and the mean MODIS-SP difference for the bin is plotted for both the 10 and 
3km products. This process is repeated in Fig. 6c and d except that the 5x5pixel 
MODIS spatial collocation technique is employed in the MODIS/SP collocations. 
io For both MODIS/SP collocation techniques, the bulk of the 3 km MODIS retrievals 
are within the ±0.05 ± 0.15 AOD expected error (67% for the single pixel technique 
and 73% for the spatial average technique). The satellite retrieval is highly correlated 
with the ground based measurements, although with a small negative offset (-0.02 for 
the single pixel technique and -0.01 for the spatial average technique) and a significant 
is slope (1 .26 for single pixel, 1 .22 for spatial average). Accordingly, the MODIS 3 km AOD 
agrees well with SP AOD at low aerosol loadings, but is generally biased high at higher 
AOD. The primary difference between the two collocation techniques is that the spatial 
average has nearly twice as many collocations (962 as opposed to 560). Therefore, 
the spatial averaging technique may be more representative of the region at large. 

20 The binned MODIS-SP differences in Fig. 6b and d agree well with the impression 
given by the scatterplots. The MODIS 3 km product is biased slightly low at AOD below 
0.1 , then is biased high above 0.1 . The single pixel collocation is likely best to compare 
the 10 km and 3 km products, because the spatial averaging technique samples a dif- 
ferent area for the different products. The 3 km product single pixel averages shown in 
25 Fig. 6b show that the average AOD of the 3 km product is frequently, but not always, 
higher than the 10 km product for bins above 0.1 AOD. 

The retrieved AOD from the FISRL airborne instrument provides a different perspec- 
tive on validation of the 3 km product. Because the plane is moving quickly in space, 
no spatial or temporal averaging is used to make the MODIS/HSRL collocations. The 
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MODIS data are sampled along the HSRL flight track, provided that the HSRL obser- 
vation is made within the geographic region mapped in Figs. 1 and 2, and is within 
30 min of the MODIS overpass. Shortening the time requirement to either 15 or 5 min 
does not significantly affect the collocation statistics, but provides far fewer colloca- 
5 tions. The HSRL and MODIS AOD are not interpolated to the same wavelength, which 
is expected to introduce between 2-4% error (Kittaka et al., 2011). It is expected that 
the AOD retrieved by the HSRL instrument would be lower than the AOD retrieved by 
MODIS by at least 0.01 to 0.02 because the HSRL instrument does not measure the 
entire column, and therefore neglects the contribution of above the HSRL profile (i.e. 
io above 7 km) to total columnar AOD. 

Figure 7 shows that the 3 km product agrees well with HSRL, although less well 
than the 10 km product. Although both MODIS products are biased high in this region 
during the study period, the 3 km product is moreso; the bias of the 10 km product is 
0.050 while the bias of the 3 km product is 0.056. The increased bias of the 3 km is 
is primarily attributed to the addition of noisy pixels that the 10 km product avoids during 
its pixel selection process. Although the 10 km product has better statistical agreement 
with HSRL, the 10 km MODIS/HSRL comparison also shows the necessity of a higher 
resolution retrieval; the stripes in the HSRL/MODIS comparison show the change in 
HSRL AOD within a single pixel - the pattern that is quantified in Fig. 5. 

20 From both AERONET and HSRL comparisons, we consider the 3 km product to be 
well validated in this region. Using either collocation technique, more than two thirds 
of MODIS/SP collocations are within the expected error of the 10 km product, which is 
more stringent than the defined EE of the 3 km product. However, the increased noise 
and urban problems give the 3 km product a larger high bias than the 10 km product. 
25 The single pixel and spatial average MODIS collocation techniques show quantitative 
but not qualitative differences. 
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4.3 Sources of uncertainty 

Figures 2 and 3 show an overestimation of AOD in urban areas. In order to study this 
further, we separate the 3 km MODIS/SP spatially averaged collocations by SP station, 
and compute agreement statistics for each station. We choose the spatial averaging 
5 collocation technique because it provides more collocations. The percent of compar- 
isons within expected error for each station is shown in Fig. 8a, and the correlation 
coefficient (/?) between MODIS and SP 0.55 pm AOD is shown in Fig. 8b. In each 
panel, land classified as “urban” by the MODIS Land Cover type product (MCD12Q1) 
is plotted in grey. 

io Figure 8a shows remarkable variability in the percent of collocations within EE for 
each SP station, ranging between 1 6 % to 95 %. The stations with the smallest percent 
within EE are clustered around the Baltimore urban center, and the more urbanized 
1-95 corridor between Washington D.C. and Baltimore. However, the stations with small 
percentages of collocations within EE still have correlation coefficients above 0.85, 
is suggesting that the error is a systematic bias that could be accounted for in future 
retrievals, and not a random error. 

We wish to quantify the urban overestimation of the 3 km product using the dense 
spatial distribution of the SP sites. Using the same 1 5 km averaging box as the MODIS 
spatial collocation, the percent of pixels within the averaging box identified as urban 
20 by the MCD12Q1 product is calculated. In Fig. 9, this quantity is plotted against the 
percent of collocations above EE for each SP site. The percent of urban land within 
the MODIS averaging box is well correlated with the percent of MODIS/SP collocations 
that are above the expected error. This confirms that the largest source of uncertainty 
in this study is related to the urban areas. The cause is suspected to be improper land 
25 surface reflectance characterization, considering that aerosol sources are not expected 
to vary significantly within the region of study and that it has been shown that the 
surface reflectance in the 0.66 urn channel over some urban surfaces is ~ 0.7 of the 
2.13 reflectance (Castanho et al., 2008; Oo et al., 2010) which is higher than the ratio 
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used in the MODIS operational retrievals. In mixed-use urban/suburban regions like 
the DISCOVER-AQ study region, it is likely that the brighter urban surface 500 m pixels 
were selectively discarded in the pixel selection process of the 1 0 km product. However, 
because the resolution of the 3 km retrieval is smaller, more urban pixels remain within 
5 the retrieval box after pixel selection, causing the surface reflectance in the visible 
wavelengths to be underestimated, leading to an overestimation in AOD. 

Ideally, the noisy pixels could be flagged as poor quality, and therefore treated with 
some degree of caution. One of the products produced operationally is the AOD at 
2.1 pm. This is not a validated product, but is used as a diagnostic to the retrieval. 
io It may hold information that can identify poorer quality 3km retrievals. In Fig. 10a, the 
2.1 pm AOD on 21 July 201 1 at 1 8:30 from the 3 km product is plotted, the same granule 
as shown in Fig. 1b, and in Fig. 10b, the 2.1 pm AOD on 1 July 2011 at 15:35 from the 
3 km product is plotted, the same granule as shown in Fig. 2b. The scene-wide 2.1 pm 
AOD is 0.042 in the left panel, and is 0.03 in the right panel. Both granules contain 
is pixels with a 2.1 pm AOD over 0.2, more than 6 to 10 times higher than the scene-wide 
average. The error is not due to the wrong aerosol model being picked; in both scenes; 
all of the pixels were assigned the fine mode dominated urban aerosol model (Levy et 
al., 2007a). It appears that the same pixels that have anomalously high 2.1 pm AOD 
retrievals also tend to have inaccurate 0.55 pm AOD retrievals. For example, the pixels 
20 with high (> 0.55) AOD in Fig. 1 b that agree with SP observations have retrieved 2.1 pm 
AOD values that do not stand out from the background. However, the pixels with high 
AOD in Fig. 2b that do not agree with SP observations, exhibit retrieved 2.1 pm AOD 
values significantly higher than the background. Although the 2.1 pm AOD retrieval is an 
unvalidated product, it may serve a purpose as a consistency check in this fine mode 
25 dominated, urban environment. This consistency check is likely to be inapplicable in 
dusty or other coarse mode dominated regimes. 

Using anomalous 2.1 pm AOD pixels as a proxy for poor quality 0.55 pm pixels, and 
therefore throwing them out, results in a reduction of the both the negative bias at 
low AOD and the positive bias at high AOD. If the 3 km product is filtered such that 
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pixels with a 2.1 pm AOD over 0.2 are excluded, and MODIS/SP are collocated using 
the spatial averaging technique, the percent within EE rises from 73% to 80%, while 
the number of collocations falls from 963 to 903, and the R rises from 0.92 to 0.95. 
However, this screening is not globally applicable, and is not recommended for use 
without closer examination. 

It appears that a primary source of error in the 3 km MODIS aerosol product is the in- 
correct estimation of surface reflectance over urban regions. This error is not as appar- 
ent in the 10 km product because brighter urban surfaces are preferentially discarded 
during the pixel selection process. However, because the 3 km product has a smaller 
footprint, it is likely that not all urban pixels are discarded, and the surface reflectance 
is underestimated, leading to an overestimation in AOD. The 2.1 pm AOD shows some 
potential as an imperfect filter for these poor quality pixels. 
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5 Summary and conclusions 

The MODIS dark target aerosol algorithms were designed with climate applications 
in mind, and the spatial scale of the retrieval reflects that design. However, as the 
applications of the aerosol product have evolved to include many facets of air quality 
studies, the proper scale at which to observe small-scale aerosol events came into 
question. In response to the needs of the air quality community, an operational aerosol 
product produced at a 3 km resolution will be available in MODIS Collection 6. 

This new product was evaluated against ground and airborne data over the 
Baltimore-Washington D.C., USA corridor over the summer of 2011 to understand the 
potential added information from the higher resolution retrieval and the statistical relia- 
bility of the product. The 1 0 km and 3 km granules generally resolve similar large scale 
patterns in aerosol distribution but differ in the details. The smaller footprint of the 3 km 
product retrieves closer to clouds and over small bodies of water, but also makes the 
product more susceptible to cloud contamination and other sources of noise. Sub-pixel 
comparisons against HSRL shows that AOD can vary significantly within a 1 0 km pixel, 
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and a 3 km resolution is an appropriate scale for studying aerosol distributions in urban 
and suburban settings. 

The dense network of AERONET sun photometers deployed during the DISCOVER- 
AQ campaign provided an unprecedented opportunity to validate aerosol products at 
5 a high spatial scale. Given the new resolution of both the satellite data and the ground 
validation network, the MODIS spatial-temporal collocation techniques for validation 
were revisited. It was found that using a spatial average of MODIS pixels around a sun 
photometer station, or using only the pixel where the SP station is located resulted in a 
quantitative, but not qualitative, difference. We conclude with good confidence that the 
10 MODIS 3 km validates within the expected error of the MODIS aerosol products in this 
region, but is biased high at AOD values greater than 0.1 . 

There is evidence that a significant source of the bias observed in the 3 km product 
results from improper characterization of urban surfaces. The method for attributing the 
surface contributions to TOA measured reflectances has been documented to underes- 
15 timate the surface reflectances in urban areas (Castanho et al., 2008; Oo et al., 2010), 
which in turn overestimates AOD. Indeed, we found a strong correlation between the 
amount of urban surface near an AERONET station, and the percent of collocations 
that are above the expected error. While case studies show that the 10 km product 
also has one or two pixels that are affected, the smaller pixel size of the 3 km product 
20 causes it to be more susceptible to contamination. 

The poor performance of the 3 km product over urban surfaces is clearly a limita- 
tion in terms of air quality applications. How to best address this problem in an op- 
erational environment remains an open question. However, despite this limitation, the 
3 km product has many qualities making it a suitable choice for air quality studies, in- 
25 eluding resolving small scale AOD gradients and point sources, the ability to retrieve in 
patchy cloud fields, and the ability to retrieve closer to coastlines. We expect that the 
added information of the 3 km resolution product will complement the existing MODIS 
10 km resolution aerosol product and products from other passive and active sensors 
to provide a more complete view of global aerosol properties from space. 
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(a) 10 km resolution, single pixel 


(c) 10 km resolution, spatial average 



(b) 3 km resolution, single pixel 



(d) 3 km resolution, spatial average 


AOD at 0.55 ^im 


Fig. 1. AOD at 0.55 pm observed by MODIS-Aqua on 21 July 2011 at 18:30UTC is plotted at 
the 10 km resolution (a, c) and 3 km resolution (b, d). MODIS/SP collocations are plotted in 
the circles. In (a)-(d), the inner circle is the SP temporally averaged AOD, which is average 
of >2SP measurements within 30 min of MODIS overpass. In (a) and (b), the outside circle 
is the AOD of the MODIS pixel containing the SP site. In (c) and (d), the outer circle is a the 
spatial average of a MODIS AOD in a 5 x 5 pixel box around the SP station. Only land pixels 
with a QA = 3 are used in the collocation. Washington D.C. is shown with the large black star 
and Baltimore, MD is shown with the small black star. The true color image, created from the 
MODIS red, green and blue bands, is shown in the background. 
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(a) 10 km resolution, single pixel 



(b) 3 km resolution, single pixel 




(c) 10 km resolution, spatial average 



(d) 3 km resolution, spatial average 


AOD at 0.55 [Am 


Fig. 2. AOD at 0.55 pm observed by MODIS-Terra on 1 July 2011 at 15:35UTC is plotted at 
the 10 km resolution (a, c) and 3 km resolution (b, d). MODIS/SP collocations are plotted in 
the circles. In (a)-(d), the inner circle is the SP temporally averaged AOD, which is average 
of >2SP measurements within 30 min of MODIS overpass. In (a) and (b), the outside circle 
is the AOD of the MODIS pixel containing the SP site. In (c) and (d), the outer circle is a the 
spatial average of a MODIS AOD in a 5 x 5 pixel box around the SP station. Only land pixels 
with a QA = 3 are used in the collocation. Washington D.C. is shown with the large black star 
and Baltimore, MD is shown with the small black star. The true color image, created from the 
MODIS red, green and blue bands, is shown in the background. 
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- 0.05 0.05 0.15 0.25 0.35 0.45 0.55 0.65 0.75 


Fig. 3. 3 km resolution AOD at 0.55 pm observed by MODIS-Terra on 29 July 2011 at 1 6:00 UTC 
is plotted in the background. HSRL 532 nm columnar AOD along the flight track between 1 5:30 
and 1 6:30 UTC is shown in the thick line. SP AOD interpolated to 0.55 pm is shown in the circles. 
The SP measurements are not temporally averaged; the nearest measurement to 16:00 UTC is 
shown, provided the measurement was taken between 1 5:30 and 1 6:30 UTC. Washington D.C. 
is shown with the large black star and Baltimore, MD is shown with the small black star. The true 
color image, created from the MODIS red, green and blue bands, is shown in the background. 
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(a) 10 km product (b) 3 km product 



-0.05 0.05 0.15 0.25 0.35 0.45 0.55 0.65 0.75 


Fig. 4. Close up view of the area enclosed in the white box in Fig. 3. (a) MODIS 1 0 km 0.55 pm 
AOD with 532 nm HSRL AOD plotted on top. (b) MODIS 3 km 0.55 pm AOD with 532 nm HSRL 
AOD plotted on top. 
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HSRL AOD Range 

Fig. 5. The maximum difference between HSRL 0.55 pm AOD measurements observed within 
a MODIS 10 km pixel, normalized by the total frequency. Only MODIS pixels that contain 6 or 
more HSRL measurements are included. 
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Fig. 6. (a) Density scatterplot of MODIS/SP collocations for AOD at 0.55 pm, using the sin- 
gle pixel collocation technique. Expected error over land (±0.05 + 0.15 AOD) is shown in the 
dashed lines, the best fit line is shown by the solid blue line, and the one-to-one line is shown & 
in the solid black line, (b) Average difference between MODIS single pixel collocations and SP 
0.55 pm AOD, as a function of SP 0.55 pm AOD. ±1 standard deviation is shown for the 3 km 
product, (c) As in (a), but the MODIS 5 x 5 pixel spatial average collocation is used, (d) As in 
(b), but the MODIS 5x5 spatial average collocation used. 
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(a) 10 km resolution 



(b) 3 km resolution 



0.0 0.2 0.4 0.6 0.8 1.0 
HSRL 532 nm AOD 


0.0 0.2 0.4 0.6 0.8 1.0 
HSRL 532 nm AOD 


Fig. 7. Density scatterplot of MODIS/HSRL collocations for AOD at 0.55 (am for MODIS and 
532 nm for HSRL for the 10 km MODIS product (a) and the 3 km MODIS product (b). The 
MODIS AOD is sampled along the HSRL flight path; no spatial or temporal averaging is per- 
formed. Expected error over land (±0.05 + 0.15 AOD) is shown in the dashed lines, the best fit 
line is shown by the solid blue line, and the one-to-one line is shown in the solid black line. 
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Correlation coefficient (R) 


0.75 0.80 0.85 0.90 0.95 1.00 


Fig. 8. (a) Percent of 3 km spatially averaged MODIS/SP collocations of 0.55 pm AOD within 
expected error (±0.05 + 0.1 5 AOD) at each SP station, (b) Correlation coefficient between 3 km 
spatially averaged MODIS 0.55 pm AOD and SP temporally averaged 0.55 pm measurements 
at each station. Land identified as urban/built up by the MODIS land cover product (MCD12Q1) 
is plotted in grey in both panels. 
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Urban landcover percentage 


Fig. 9. Percent of 3 km spatially averaged MODIS/SP 0.55 pm AOD collocations above ex- 
pected error (+0.05 + 0.15 AOD) at each SP station, plotted against the percentage of pixels 
within the 15 km by 15 km collocation box identified as urban by the MODIS land cover product. 
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(a) 2 1 July 20 1 1 , 1 8:30 UTC (b) 0 1 July 20 1 1 , 1 5:35 UTC 



AOD at 2.1 nm 
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Fig. 10. (a) 3km AOD at 2.1 pm observed by MODIS-Aqua on 21 July 2011 at 18:30 UTC. 
(b) 3 km AOD at 2.1 (am observed by MODIS-Terra on 1 July 201 1 at 15:35 UTC. Only land pix- 
els with a QA = 3 are shown. Washington D.C. is shown with the large black star and Baltimore 
is shown with the small black star. The true color image, created from the MODIS red, green 
and blue bands, is shown in the background. 
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